SDSC Hosts Talk by P.K. Yeung on Large Turbulence Simulations

Published 07/08/2005

Professor P.K. Yeung of Georgia Tech speaking in SDSC's Computational Science Seminar Series about the use of the SDSC DataStar supercomputer in large-scale simulations of turbulent flows.

Noted researcher in computational approaches to fluid turbulence, Professor P.K. Yeung of the School of Aerospace Engineering at Georgia Institute of Technology, spoke at the San Diego Supercomputer Center (SDSC) at UC San Diego on July 6. Yeung's talk, part of SDSC's Computational Science Seminar Series, was on "The Challenge of Fluid Turbulence: the Science, the Data, and Use of Computational Power."

Perhaps the most important unsolved problem in classical physics, an improved understanding of turbulence will have a wide range of applications in both basic science and applied technology in fields from aeronautics, meteorology, and combustion to environmental problems. Turbulent flows are characterized by disorderly fluctuations across a wide range of interacting scales in time and space in an "energy cascade." Because of this, turbulence is highly effective at mixing heat or chemical species and dispersing contaminants. Despite decades of study, however, the complexity of these flows has resisted theoretical description, limiting researchers' ability to predict natural phenomena and design improved engineering technologies.

Recent advances in computational power are opening significant opportunities to advance the understanding of turbulence. "Computing has matured into an important alternative and complement to experiments," said Yeung. "And the expertise, large computing resources, and fast turnaround at SDSC are helping us make significant progress." More realistic simulations are now generating large amounts of data at such high resolution that they sometimes surpass the detail that can be obtained in experiments. Consequently, there is growing interest in these simulation results, and Yeung is working to establish a resource that will make this valuable data available to the wider community.

Turbulent fluctuations in this fluid jet promote efficient mixing. Large simulations by P.K. Yeung on SDSC's DataStar are giving new understanding of the complex mechanisms of mixing and contaminant dispersion, including for slow-diffusing substances that have been difficult to study. Image courtesy of K.R. Sreenivasan, U Maryland.

Yeung's research is supported primarily by the National Science Foundation (NSF), and involves collaborators graduate student Diego Donzis of Georgia Tech, K. R. Sreenivasan of the University of Maryland and International Center for Theoretical Physics in Italy, and S.B. Pope of Cornell University. With them, he is probing the details of turbulence through direct numerical solutions (DNS) of the governing Navier-Stokes equations. By avoiding approximations, this approach produces highly realistic results available no other way, but it is also very computationally demanding.

One of the larger users of SDSC resources, Yeung is running on SDSC's DataStar supercomputer with an allocation of some 1.2 million CPU-hours. In his talk, Yeung presented recent advances in his simulations made possible by using a cube domain with 2,048 grid points per side, double the previous 1,024, for a total of some 8 billion grid points. These simulations are the highest resolution of their kind to date in the U.S. As the problem size grew to 2,048 points per side, the researchers achieved an 80% efficiency in scaling, with the computations running on 1,024 processors of DataStar using some 560 Mb of memory. Yeung generated 20 data sets of the full velocity field of 160 GB each, for a total of more than 3 TB of data.

One result of interest in environmental problems involves the spread of contaminants released in plumes. Yeung's simulations showed that particle separation statistics are larger than anticipated, implying that small amounts of contaminant can be found farther from a source than expected. Yeung noted that "these simulations demonstrate that you need to look at higher order statistics of the flow, not just the average or variance, to accurately predict how far contamination may spread." According to Yeung, the power of DataStar has enabled him to address challenges that arise in simulating the behavior of substances that diffuse slowly, such as in liquids, which have previously been very difficult to simulate.

As detailed as the present simulations are, there are still important questions about turbulence that can only be answered through still higher resolution simulations. In the future, Yeung would like to extend his research to double the domain size, 4,096 grid points per side, for a total of more than 65 billion grid points. Although simulations of this type have been done on Japan's Earth Simulator, it is not yet possible even on the largest computational resources available in the U.S. Working with SDSC computational scientists Giri Chukkapalli and Dmitri Pekurovsky in a Strategic Applications Collaboration (SAC), Yeung is now exploring modifications to his code that can help scale up toward the elusive goal of 4,096 grid points per side, bringing additional realism to simulating turbulent flows.

At the conclusion of Yeung's talk, there was a lively interchange with Professor Carl Gibson of Jacobs School of Engineering and Scripps Institution of Oceanography (SIO) at UCSD, who does research in turbulence. Gibson and his colleagues are excited by the detail of Yeung's simulation results, which complement their experimental and theoretical research. "It's an exciting time in turbulence research," said Yeung. "With the help of DataStar, our highly detailed simulations are giving us new answers to long-standing problems in turbulence." -Paul Tooby